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1 The Fly Pentop Computer 

Advertised as "a computer in a pen" , the Fly Pentop computer (ref web site) 
hit the stores in the fall of 2005. One application of the pen is a four-function 
calculator that the user draws on a special kind of paper called "Fly paper". 
The pen seems to know what numbers have been written and where on the 
paper the numbers lie, because after tapping on what was drawn (e.g. 5, +, 
3, 7, =), the computer announces the result of "42". The pen can also read 
handwriting, and there are a number of games printed on "Fly paper" that are 
based on the pen knowing the location of objects on the paper. How does the 
pen know where symbols and objects are on the paper? And what does the 
following quote from a recent article (cite Wired) about this computer mean: 
"The pen knows where it is within a 1.8- million- square-mile grid"? 

The Fly Pentop Computer uses paper which has a position code lightly 
printed on it. A position coding pattern is an array of symbols in which sub- 
arrays of a certain fixed size appear at most once. So, each subarray uniquely 
identifies a location in the larger array, which means there is a bijection of some 
sort from this set of subarrays to a set of coordinates. The key to "Fly paper" 
and other examples of position codes is a method to read the subarray and then 
convert it to coordinates. So, for the calculator application, when the calculator 
is first drawn, the pen reads a symbol such as "2" through optical character 
recognition, and also reads the position of the "2" by interpreting the position 
code on the paper. When the "2" is later tapped, the position code is read 
again, and the fact that a "2" is there is recovered from the pen's memory. 

Position coding makes use of ideas from discrete mathematics and number 
theory. In this paper, we will describe the underlying mathematics of two po- 
sition codes, one being the Anoto code that is the basis of "Fly paper". Then, 
we will present two new codes, one which uses binary wavelets as part of the 
bijection. 



2 The Resnik Position Code 

The CCD Rasnik Straightness Monitoring System [5] is a position coding pattern 
that was designed for the muon detector at CERN, the European Organization 
for Nuclear Research. Because the detector could not be built to be sufficiently 
stable to measure absolute positions, the relative position of the components are 
continously monitored. This is done by determining the positions of lightspots 
shined on the components. 

In this pattern, each position coding block, which is called a B3, codes for 
a unique position. Each B3 is composed of smaller pixels, and the size of a B3 
is 9 X 11 pixels. The coding for the x coordinate occurs in the first column of a 
B3, and the coding for the y coordinate occurs in the bottom row. This coding 
is done by using codebits, which appear as black squares. If a codebit is present 
in a particular field, that field assumes the value 1. All fields without codebits 
are considered 0. To determine the x coordinate, one simply translates the first 
column into Os and Is, and the binary number associated with this column is 
the appropriate x coordinate. The same is true for determining the y coordinate 
along the bottom row. Figure [T] shows an example of a B3. Coordinates in the 
range < a; < 255, < y < 1023 can be coded. In addition, each B3 has a 
"startbit" in the lower left-hand corner, for reference. 
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Y=100 

Figure 1: Example of a B3 

In order to make the this position coding appear more random, and to create 
a more stable average illumination of the pattern, each B3 is overlayed with a 
9x11 chessboard. If a codebit is present, the particular chess square associated 
with this codebit will be converted to the opposite color. That is, if a codebit 
is overlayed with black square from a chessboard, that square will be converted 
to white, and if the square was white, it would be changed to black. Figure |2] 
shows a sample of this position coding pattern, which contains several B3s. 

To determine a Resnik location, a 9 x 11 subarray is read, and the chessboard 
overlay is undone via XOR, yielding a B3 as in Figure 1, or part of a B3 (which 
we will call the "main B3") along with parts of adjacent B3s. Because adjacent 
B3s differ in their x or y coordinates by one unit, because of the reference 
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Figure 2: Position Coding Pattern for the Rasnik Mask 



start bits, and because the bottom row and left column are all that are neeed to 
determine the postion, the unknown parts of the main B3 can be deduced from 
the information in the adjacent B3s. 

3 The Anoto Pattern 

The position coding pattern used by "Fly Paper" is the Anoto pattern, patented 
by the Anoto corporation. It appears that the precise pattern found in patent 
WO 03/038741 [3] is used by "Fly paper", based on an analysis of samples. This 
came as a bit of surprise, as Anoto describes the details in this patent as merely 
an "example" . 

The Anoto pattern is made up of many small dots offset from a grid, which is 
called a raster. Each of the dots is offset in one of four directions, thus encoding 
two bits of information. A diagram of an enlarged piece of the pattern is shown 
in figure |3l This dia gram is a typical subarray that can be associated with an 
(a;, y) pair. The dotted lines in this diagram represent the grid, which does not 
actually appear on the paper. The pattern has the property that any 6x6 array 
of dots appears only once. This allows a device to determine a location within 
the grid by only looking at a 6 x 6 array. 

A certain type of sequence, called a De Bruijn sequence, is related to some 
aspects of the code. Given a finite set S = {si, S2, ■ ■ ■ , s^}, a cyclic sequence 
of length fc" of elements in S in which every subsequence of length ri appears 
exactly once is called a De Bruijn sequence of order n [TT]. Some of the se- 
quences in the pattern are similar to De Bruijn sequences, but are not of max- 
imal length. We will call a cyclic sequence of length m < fc" of elements of 
S = {si, S2, ■ ■ ■ , Sk} in which any subsequence of length n appears no more 
than once a quasi De Bruijn sequence of length m from the alphabet S. The 
problem of finding quasi De Bruijn sequences is related to the shortest common 
superstring problem [5]. 

In the pattern, one bit from each dot is used to code the x coordinate and the 
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Figure 3: Fly Paper 
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other is used to code the y coordinate. For each coordinate, there is a repeated 
quasi De Bruijn sequence of order 6 of length 63 from the alphabet {0, 1}. This 
sequence is called the main number sequence (for a given coordinate) . The main 
number sequence used in the Anoto pattern is the following: 

{0,0,0,0,0,0,1,0,0,1,1,1,1,1,0,1,0,0,1,0,0,0,0,1,1,1,0,1,1,1,0,0,1,0,1,0, 
1,0,0,0,1,0,1,1,0,1,1,0,0,1,1,0,1,0,1,1,1,1,0,0,0,1,1}. 

For the x direction, translations of the main number sequence by numbers 
between and 62 are coded in columns. That is, each column contains the same 
cyclic sequence moved up or down by some number of rows. The difference 
between the amount by which any two adjacent columns are translated forms 
a member of a sequence called the primary difference sequence. We will denote 
this sequence by {dn}n>i- In other words, if the fc*'^ column is translated down 
by £ and the k+ 1*^* column is translated down by to, then dk = i — m (mod 63). 
This is shown in Figure |4j Since the main number sequence is a quasi De Bruijn 
sequence of order 6, it is possible to determine dk using adjacent subsequences 
of length 6 in the /c*'' and k + 1*** columns. If the subsequence from column k 
starts at £ and the adjacent subsequence from column k + I starts at to, then 
dk = £ — rri (mod 63). 



X 



m 



Figure 4: Calculation of a Member of the Primary Difference Sequence 



Since the members of the primary difference sequence are determined mod- 
ulo 63, each member must be between and 62. However, as stated in the 
patent, only numbers in the set {5, . . . , 58} are allowed. This set has 54 = 2 • 3'^ 
elements, so there are bijections from {5, . . . , 58} to {(ai, 02, 03, a4)|ai, 02, 04 S 
{0, 1, 2}, 03 £ {0, 1}}. We can define one such bijection, which we will call cj), by 
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the following rule. For any r € {5, . . . ,58}, there is a unique (01,02,(13,014) € 
{(ai, 02, 03, a4)|ai, a2, 04 G {0, 1,2}, 03 € {0, 1}} such that 

r = 5 + fli + a2 • 3 + as • 3^ + 04 • 2 • 3^ 

Let (/)(r) = {(f>i{r),(j>2{r),(f>a{r),(f)4{r)) = (ai, 0,2, 03, 04). 

For £ from 1 to 4, define the sequence {a^,n}ra>i by a^^^ = <pi{dk)- These 
sequences are called the secondary number sequences. Each of the sequences 
{cii.n}n>i, {o,2.n}n>i, and {a4.„}„>i are formed by repeating quasi De Bruijn 
sequences from the alphabet {0,1,2} of order five of lengths 236, 233, and 
241 respectively, while the sequence {as^n}n>i is formed by repeating a quasi 
De Bruijn sequence from the alphabet {0,1} of order five of length 31. The 
lengths of these quasi De Bruijn sequences are chosen to be relatively prime 
so that the least common multiple of all of the lengths is their product. For 
Fly Paper, 236, 233, 31 and 241 are relatively prime, so lcm(236, 233, 31, 241) = 
236 -233 -31 -241 = 410815348. So, for any dk in the primary difference sequence, 
dk = 'A~^((oi,fc,02,fc,a3,fc,a4,fc)), which means that any subsequence of length 5 
in the primary difference sequence occurs once every 410815348 elements. 

The position of dk in the primary difference sequence is one of the pieces of 
information that codes the x coordinate. However, the same primary difference 
seqTience can be achieved if the translation of the main number sequence in 
each column is translated down by i rows for any i from to 62. How fax down 
all of the translations of the main number sequences are translated determines 
another piece of information about the x coordinate, called the section. Thus, 
the X coordinate is encoded by a section and a place in the primary difference 
sequence. The encoding of the y coordinate uses the remaining bit and is similar 
to the encoding of the x coordinate with all of the sequences perpendicular to 
their counterparts for the x coordinate. Both coordinates can use the same 
system of sequences. 

We have writtcm a Maple program, which can be found in the Maple work- 
sheet anoto_work2 .mws, to convert a scanned image of the Anoto pattern into 
arrays of bits and look for the sequences described in the patent. Using this 
Maple program, we have found the main number sequence and secondary dif- 
ference sequences for encoding the y coordinate that seem to be the same as the 
ones described in the patent. We have also found the main number sequence and 
the base 2 secondary difference seqTience for th(^ x direction. These sequences 
are identical to the ones used for the y coordinate. Although we have not found 
the other secondary difference sequences for the x coordinate, we expect that 
they are the same. 

4 deBrujin tori 

One topic that may be useful in creating position coding patterns is the study of 
De Bruijn tori. An (i?, S'; to, n)fe-De Bruijn torus is a two dimensional toroidal 
array with R rows and S columns in which every m x n array of elements from 
a set with k elements appears exactly once, including the parts of the torus 
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where the array wraps around and meets itself [S]. Such an array satisfies the 
necessary property for position coding patterns of having every m x n array 
appear at most once. However, a Dc Bruijn torus may not be an ideal position 
coding pattern if there is no efficient way of finding the position of a given 
section. 



5 A Position Coding Pattern that Uses Binary 
Wavelets 

We have created two position coding patterns, one of which uses binary wavelets. 
Binary field wavelets are quite similar to wavelets of the real field. Binary 
wavelet filters are constructed to satisfy certain properties, some of which are 
analagous to the real field wavelets. Three key properties that are important are 
the bandwidth constraint, the vanishing moments constraint, and the perfect 
reconstruction constraint [T^. The perfect reconstruction constraint states that 
the wavelet transform must be invertible, while the others ensure that wavelet 
transforms of certain arrays have certain desirable properties. For example, 
the vanishing moments constraint ensures that the transforms of nearly linear 
arrays have few nonzero entries in the detail filters. 

We have created a position coding pattern using these binary wavelet filters. 
The filter that we are using is determined by the matrix 

"1 1 1" 
^^1110 
110 
11 

The transform of a 4 x 4 matrix F is given by TFT* . For the coding of our binary 
wavelet pattern, each coordinate is determined by a 4 x 4 matrix. Specifically, 
the top two rows of each matrix determine the x coordinate and the bottom two 
rows determine the y coordinate. This coding is done simply by using binary 
numbers, as shown in the matrix below. The position values in blue (the top 
two rows) represent the x coordinate, and the values in red (the bottom two 
rows) represent the y coordinate. 

2^ 2^ 2^" 
2^ 2^ 2"^ 
2^ 2^ 2^ 
2^ 2^ 2"^ 

As an example, suppose we wished to code for the position (12, 108). Then the 
corresponding matrix G would appear as follows: 

11" 



11 

110 



2° 
24 
2° 
24 



G = 
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To continue with the coding process, we would then apply the inverse of the bi- 
nary wavelet transform to this matrix. That is, we would compute T~^G'(T*)~^ 
to attain a new matrix representation of the coordinate (12, 108). This new rep- 
resentation is how the coordinate would appear in the position coding pattern. 

This binary wavelet pattern can code for positions (0, 0) through (255, 255), 
and so it can code of a total of 255 x 255 = 65536 unique positions. Because each 
position is represented by a 4 x 4 matrix, the position coding pattern appears 
as a 1024 x 1024 binary matrix. Additionally, we can represent this data as 
an image consisting of black and white pixels, where the black pixels stand for 
zeros and the white pixels stand for ones. Figure |5] shows the entire position 
coding pattern as a black and white image, and figure [6] is a close-up of a small 
portion of the image. 



Figure 5: Image of the Binary Position Coding Pattern 



While this position coding pattern works fairly well, its main limitation 
is that it requires gridlines or some form of delimiters in order to distinguish 
individual matrices. One of our goals is to improve upon this and to eliminate 
the need for any form of delimiters. 
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Figure 6: Close-up of the Binary Position Coding Pattern 



6 A Non Wavelet-Based Position Coding Pat- 
tern 

Although the wavelet based pattern relies on delimiters, we have created a 
method of making binary position coding patterns that does not use delimiters. 
Given even m and n, we can create a binary position coding pattern in which 
m X n sections are unique. 



6.1 The 4 by 4 Version of the Pattern 

The 4 by 4 version of the pattern is a 48 x 576 array in which any 4x4 section 
appears at most once. Each entry in the array is either or 1. The position of 
any 4x4 section can be determined using a lookup table that is much smaller 
than the size of the actual pattern. Figure [7] shows the entire pattern. A black 
pixel represents a zero, while a white pixel represents a one. We will call the 
entire pattern P and denote the entry i — I units down and j — 1 units to the 
right from the upper left entry by Pi j and call this entry the i, jth entry. 



1]JJS..S;.j:: 



. i'.'.-K'.l''-- 




Figure 7: Image of the Non Wavelet-Based Binary Position Coding Pattern 



In any 4x4 section, eight entries code two base 12 digits for the x coordinate, 
four entries code a single base 12 digit for the y coordinate, and the remaining 
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four digits code the position of each coordinate modulo 4. The pattern is created 
by meshing together the axray 



U = 



1 




with arrays from the sequence 



A = 











1 
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7 
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1 


7 


1 







1 1 







1 



1 
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1 
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1 
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1 
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1 
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1 








1 1 
1 1 



The sequence A is used to code base-12 digits for each 4x4 block for which both 
coordinates for the upper left corner are congruent to 1 modulo 4. Specifically, 
if j = 12(ji — 1) + (jo ~ 1) for some jo and ji from 1 to 12, then the 4x4 array 
starting at 4i + 1, 4j + 1 is given by 



1 



(^i)l,2 



(^Jo)l,l 
(^Jl)2,l 
(^Jo)2.1 







(^i)2,2 



(%)l,2 
(^Jo)l,2 
(^Jl)2,2 
(^^o)2,2 



where i and j are nonnegative integers with z < 11 and j < 143. Note that if 
i and j are both odd, Pij is one of the entries in the array U. Otherwise, Pij 
is part of the code for a base 12 digit for one of the coordinates. If i is odd 
and j is even, Pij is part of the pattern that codes ji, the 12s digit for the x 
direction. If i and j arc both even, Pij is part of the pattern that codes jo, the 
Is digit for the x direction. If i is even and j is odd, Pij is part of the pattern 
that codes what is in the 4x4 case the only digit for the y coordinate. 

Since the pattern is created by meshing together 2x2 arrays, we will in- 
troduce some notation to capture how this is done. For any array Z, we will 
denote by Z{i,j; m, n) the 2x2 array given by 

7 7 

Thus, for any nonnegative integers i and j = 12(ji — 1) + (jo — 1) with i < 11 
and j < 143, we have 

P(4i + l,4j + l;2,2) = U 

P(4i + l,4j + 2;2,2)=Aj, 

P(4i + 2,4j + l;2,2) = (Ai)* 

P(4i + 2,4j + 2;2,2) = 

It will also be helpful to introduce names for some of the translations of U 
and the elements of the sequence A. We will denote by R the set of translations 
of U. That is, 



R 








1 






















1 





•> 
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We can form a sequence of arrays B by taking the second column of each array 
in sequence A along with the first column of the array that occurs next in the 
sequence, wrapping around when the end is reached. That is, define 



B, = 



{^i)l,2 (^(i mod 12) + l)l,l 
{^1)2,2 (^(j mod 12)+l)2,l 



for i from 1 to 12. This gives 



B = 










1 















1 







1 


1 






1 


1 




1 


1 







1 




1 








1 

1 1 



1 
1 








1 




1 


1 




1 


1 




1 


1 






1 





1 








5 


1 


1 







1 





1 
1 



Sequences A and B have two important properties. Every array appears at 
most once in each sequence and no array in either sequence has exactly one 1 
and three Os. 



6.2 Decoding 

Suppose Y is the 4x4 array starting at P4i+m,4j+n with m,n G {1,2, 3, 4}. The 
first step in decoding the coordinates Ai + m and 4j + n is to find m and n. If 
m e {2,3} and n e {2,3}, then 




1 



y(4-m,4-n;2,2) = 
If m e {2, 3} and n e {4, 1}, then 

y(4 - m, 2 - (n mod 4); 2, 2) 
If m e {4, 1} and n e {2, 3}, then 

F(2- (mmod 4),4-n;2,2) 
Finally, if m € {4, 1} and n e {4, 1}, then 

Y{2 - (m mod 4), 2 - (n mod 4); 2, 2) 





1 



1 




1 




Thus, we will have Y{k, £; 2,2) € R for some k,£€{l, 2}. As long as Y{k, £; 2, 2) e 
R for only one value of {k,i), which is, in fact true, as will be shown later, the 
cases will not overlap and m and n can be uniquely determined. 

Once m and n have been determined, the next step is to find i and j. Suppose 
j = 12(ji — 1) + (jo — 1) where ji and jo are nonnegative integers from 1 to 12. 
To find jo, the values Yfc,^ for which m — l + k and n—l + i are both even can be 
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examined. That is, let r and ,s be the least positive integers for which m — 1 + r 
and n — 1 + s are both even and consider the array F(r, s; 2, 2). This array will 
contain the values that code jo- There are 4 possible cases. If m,n G {1,2}, 
then 

(^Jo)l,l (^Jo)l,2 



Y{r,s;2,2) 
If m e {1, 2} and n e {3, 4}, then 



r(r,s;2,2) = 
If m e {3, 4} and n e {1, 2}, then 



(^jo)l,2 (^Oo mod 12)+l)l,l 
(^jo)2,2 (^Oo mod 12)+l)2,l 



y(r,s;2,2) = 
If m e {3, 4} and n e {3, 4}, then 



(^Jo)2,l (^jo)2,2 
(^jo)l,l (^jo)l,2 



r(r,s;2,2) 



(-4jo)2,2 (-4(jo mod 12) + l)2,l 
(^jo)l,2 (^Oo mod 12)+l)l,l 



The last two cases code the same x coordinates as the first two cases respectively, 
and either of the second two cases can be reduced to one of the first two by 
flipping the rows of Y{r, s; 2, 2), so we only have to worry about the first two 
cases. In the first case ja can be found by looking Y{r, s; 2, 2) up in a table 
with sequence A. In the second case, jo can be found by looking up Y{r, s; 2, 2) 
in a table with sequence B. In the second case, we will have to keep track of 
whether Jq = 12 for the coding of the next digit. 

The next digit for the x coordinate can be found in a similar way. This 
time, we let r and s be the least positive integers for which m — 1 + r is odd 
and n — 1 + s is even and examine Y(r, s; 2, 2). Rather than 4 cases that reduce 
to 2 by flipping rows, there are now six cases that reduce to 3 by flipping rows. 
Specifically, if m e {2,3}, we can flip rows to get the same array as one of the 
following cases in which m G {1,4}. If m e {1,4} and n G {1, 2}, then 



y(r,s;2,2) 



(^.Ji,i 



(^.Jl,2 
(^ii)2,2 



If m S {1, 4} and n <E {3, 4} and it is not true that jo = 12 and the array coding 
jo was part of sequence B, then 



F(r,s;2,2) 



(-4,1)2,2 {Ajj2,l 



If m e {1,4} and n € {3,4} and we have jo = 12 and the array coding jg was 
part of sequence B, then 



r(r,s;2,2) 



(^ji)l,2 (^(ji mod 12)+l)l,l 
(^^1)2,2 (^(ji mod 12)+l)2,l 



= Bi 
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In the second case, ji can be found by switching the columns of Y{r, s; 2, 2) to 
get Aj-^ and looking up Y{r, s; 2, 2) in a table with sequence A. In the first and 
third cases, we can find ji by looking up Y{r, s; 2, 2) in a table with sequence A 
for the first case or B for the third. 

In the 4x4 case, the y coordinate is completely determined by the single 
digit i along with m. Once m is known, i can be determined by looking at the 
values Yk^e for which m — 1 + fc is even and n — 1 + ^ is odd. This involves finding 
the least values of r and s for which m — 1 + r is even and n — 1 + s is odd and 
looking at F(r, s; 2, 2). In fact, i can be determined by looking up Y{r, s; 2, 2)* 
in a table with sequence A or B depending on m in a way that is analagous to 
how the X digits are decoded. 

It should now be clear why Y{k, £; 2, 2) can be in R for only one value oik,£ G 
{1, 2}. Once one value of fc, £ G {1, 2} has been found that gives Y{k, £; 2, 2) e R, 
all other values will give an array consisting of some permutation of the elements 
in an array in sequence A or sequence B. Since elements of A and B never have 
exactly one entry equal to 1, no permutation of any of these elements will be in 
i?, so no other value of A:, ^ e {1, 2} will give Y{k, £; 2, 2) e R. 

As an example, suppose we are given the 4x4 array Y with the upper left 
corner at ^5,201 without knowing the coordinates of the 4x4 array. This gives 



Y = 



10 1 
1 
10 1 
111 



Since 



F(l,l;2,2) = 



both digits are congruent to one modulo four, and all of the arrays will be 
looked up in a table with sequence A without being fiipped. The digits for each 
coordinate can be found using sequence A. We have 



r(2,2;2,2) 





1 1 



so Jo 



so ji — 5, and 



r(l,2;2,2) = 



F(2,l;2,2) 



1 

1 1 



so i = 2. To illustrate this more clearly, each of these arrays appears in a 
different color in the depiction of the array Y above. This gives x — {{ji — 1) ■ 
12 + (jo - 1)) • 4 + 1 = (4 • 12 + 2) • 4 + 1 = 201 and y = i • 4 + 1 = 1 • 4 + 1 = 5. 
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